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Abstract 

On , , 

fSJ Bourgain [Bou02| showed that any noise stable Boolean hmction / can be well-approximated 

by a junta. In this note we give an exponential sharpening of the parameters of Bourgain's result 
under the additional assumption that / is a halfspace. 

u 

^ 1 Introduction 

There is a sequence of results |NS941 IFri981 IBou02j in the theory of Boolean functions which share 
the following general flavor: if the Fourier spectrum of a Boolean function / is concentrated on 
low-degree coefficients, then / must be close to a junta (a function that depends only on a small 



> 

o 



00 number of its input variables). Bourgain's theorem [Bou02] is the most recent and strongest of 

these results; roughly speaking, it says that if a Boolean function / has low noise sensitivity then 

O 



/ must be close to a junta. See Section 1.1 for definitions and a precise statement of Bourgain's 
theorem. 

The parameters in the statement of Bourgain's theorem are essentially the best possible for 
general Boolean functions, in the sense that the n-variable Majority function almost (but not quite) 
^> satisfies the premise of the theorem - its noise sensitivity is only slightly higher than the bound 

^ required by the theorem - but is very far from any junta. It is interesting, though, to consider 

^ whether quantitative improvements of the theorem are possible for restricted classes of Boolean 

functions; this is what we do in this paper, by considering the special case when / is a halfspace. 
In |DS09] a quantitatively stronger version of an earlier "junta theorem" due to Friedgut |Fri98j 
was proved for the special case of halfspaces, and it was asked whether a similarly strengthened 
version of Bourgain's theorem held for halfspaces as well. Intuitively, any halfspace which has noise 
sensitivity lower than that of Majority should be "quite unlike Majority" and thus could reasonably 
be expected to depend on few variables; our result makes this intuition precise. 

In this note we show that halfspaces do indeed satisfy a junta- type theorem which is similar 
to Bourgain's but with exponentially better parameters. Our main result shows that if / is a 
halfspace which (unlike the Majority function) satisfies a noise sensitivity bound similar to the one 
in Bourgain's original theorem, then / must be close to a junta of exponentially smaller size than 
is guaranteed by the original theorem. Our proof does not follow either the approach of Bourgain 
or of |DSQ9] but instead is a case analysis based on the value of a structural parameter known as 
the "critical index" [SctOTI iDGJ+lOi lUSTT] of the halfspace. 
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1.1 Background and Statement of Main Result. 

We view Boolean functions as mappings / : {—1, 1}"— )•{ — 1, 1}. All probabilities and expectations 
over X S {—1,1}" are taken with respect to the uniform distribution, unless otherwise specified. 
We say that f,g : {—1, 1}"— )•{— 1, 1} are e-close to each other (or that g is an e-approximator to /) 
ifPr[/(x) <e. 

A function / : {—1, 1}"— T-j— 1, 1} is said to be a "junta on J" C [n]" if / only depends on the 
coordinates in J'. We say that / is a J-junta, < J < n, if it is a junta on some set of cardinality 
at most J. 

Definition 1 (Noise sensitivity). The noise sensitivity of a Boolean function f : {—1, 1}"— )•{— 1, 1} 
at noise rate e is defined as 

NS,(/) = Pr[/(x)//(y)], 

where x is uniformly distributed and y is obtained from x by flipping each bit of x independently 
with probability e. 

Bourgain's theorem may be stated as follows (see Theorem 4.3 of |KN06| ) . 

Theorem 2 ([B3u02]). Fix f : {-1, 1}"^{-1, 1} and e,5 sufficiently small^ If m^{f) < 
((5yi)i+°(i), then f is 6-close to a 2*^(1/^) • poly (1/5) -junta. 

A half space, or linear threshold function (henceforth simply referred to as an LTF), over {—1, 1}" 
is a Boolean function / : {—1, !}"—;■{— 1, 1} of the form f{x) = sign(^"^]^ WjXj — 9), where 
wi, . . . ,Wn,0 £ M. The function sign(z) takes value 1 if z > and takes value — 1 if 2; < 0; 
the values wi, ... ,Wn are the weights of / and 6 is the threshold. LTFs have been intensively 
studied for decades in many different fields such as machine learning and computational learning 
theory, computational complexity, and voting theory and the theory of social choice. 

Our main result, given below, is a strengthening of Bourgain's theorem for halfspaces: 

Theorem 3 (Main Result). Fix f : {— 1, 1}"— T-j— 1, 1} to be any LTF and e,6 sufficiently small. 
Ifm.if) < 0((5(2-^)/(i-^)y^), then f is 6-close to an O ((l/e^) • log(l/e) • log (1/5)) -junta. 

Theorem [3] requires a slightly stronger bound on the noise sensitivity in terms of 5, namely 
as much as 5^~'^)/(^~'^) versus essentially 6, but the resulting junta size bound of Theorem [3] is 
exponentially smaller, both as a function of e and of 5, than the bound of Theorem [2} 

2 Preliminaries 
2.1 Basic Notation. 

For n G Z+, we denote by [n] the set {l,2,...,n}. For a,b,e G M4- we write a w 6 to indicate 
that |a — 6| = 0{e). Let M{fi,a'^) denote the Gaussian distribution with mean /x and variance o"^. 
Let 4>, $ denote the probability density function (pdf) and cumulative distribution function (cdf) 
respectively of a standard Gaussian random variable X A/'(0, 1). 

^Here and throughout the paper, "sufficiently small" means "in the interval (0, c)" where c > is some universal 
constant that we do not specify. 
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2.2 Probabilistic Facts. 

We require some basic probability results including the standard additive Hoeffding bound (see 
e.g. IDPOQQ : 

Theorem 4. Let Xi, . . . he independent random variables such that for each j G [n], Xj is 
supported on [aj,bj] for some aj,bj G M, aj < bj. Let X = 'Yl^=i-^j- Then, for any t > 0, 

Pr [|X - E[X]| >t\< 2exp (-2tV Y^^ib, - a,f) . 

The Berry-Esseen theorem (see e.g. |Fel68] ) gives explicit error bounds for the Central Limit The- 
orem: 

Theorem 5. (Berry-Esseen) Let Xi, . . . , X^ be independent random variables satisfying E[Xj] = 
for all i £ [n], ^J^i^Xf] = a, and = P3- Let S = and let F denote the 

cumulative distribution function (cdf) of S. Then sup^ ~ ^{x)\ < p-^/a^. 

Definition 6. A vector w = {wi, . . . ,Wn) G is said to be r-regular i/maxj \wi\ < t\\w\\2- 

An easy consequence of the Berry-Esseen theorem is the following fact, which says that a 
r-regular linear form behaves approximately like a Gaussian up to error 0(r): 

Fact 7. Let w = {wi, . . . ,Wn) be a r-regular vector in M" with \\w\\2 = 1. Then for any interval 

[a,b] C M., we have Pr[X]iLi "^i-^* ^ ('^i ^]] ^ *^(^) ~ ^(^)- (In fact, the hidden constant in the ~ is 
at most 2.) 

We say that two real-valued random variables X,Y are p-correlated if E[Xy] = p. We will 
need the following generalization of Fact [7] which is a corollary of the two-dimensional Berry-Esseen 
theorem (see e.g. Theorem 68 in |M0RS1^ ). 

Theorem 8. Let w = {wi, . . . ,Wn) be a r-regular vector in M" with \\w\\2 = 1. Let {x,y) be a pair 
of p-correlated n-bit binary strings, i.e. a draw of {x,y) is obtained by drawing x uniformly from 
{— 1, 1}" and independently for each i choosing yi G {—1, 1} to satisfy E[xiyi] = P- Then for any 

intervals /i C M and I2 '^R we have Pr[(^"=i it^iXj, XlLi ^ {h,l2)] ^ Pi"[(X, y) G (/i,/2)], 
where {X, Y) is a pair of p-correlated standard Gaussians. 

2.3 Fourier Basics over {—1,1}". 

We consider functions / : {—1, 1}"— t-M (though we often focus on Boolean- valued functions which 
map to { — 1,1}), and we view the inputs x to / as being distributed according to the uniform 
distribution. The set of such functions forms a 2^-dimensional inner product space with inner 
product given by {f,g) = E[f{x)g{x)]. The set of functions {xs)sc[n] defined by xs{x) = DieS^* 
forms a complete orthonormal basis for this space. We will often simply write xs for nies-^*- 
Given a function / : { — 1, 1}"— >-M we define its Fourier coefficients by f{S) *== K[f{x)xs], and we 
have that f{x) = J2s f(^)^s- 

As an easy consequence of orthonormality we have Plancherel's identity {f,g) = X^s fi'S)d{S), 
which has as a special case Parseval's identity, E[/(x)^] = 'Yls f^^)"^ ■ Fi'o™ this it follows that for 
every / : {— 1, l}"— )•{ — 1, 1} we have ^gfiS)"^ = 1. It is well-known and easy to show that the 
noise sensitivity of / can be expressed as a function of its Fourier spectrum as follows NSe(/) = 

5-^E5cH(l-2^)'^'•/(^)'■ 
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3 Proof of Theorem [3] 



Fix e,<5 sufficiently small. Let / : {-1, 1}"^{-1, 1} be an LTF satisfying m,{f) < 0{6~- ■ ^e). 
We will show that / is J-close to an O ((l/e^) • log(l/e) • log(l/(^))-junta. 

We start by observing that for < -y/e the desired statement follows easily; indeed, under the 
assumption of the theorem / is (5-close to a constant function. This is formalized in the following 
simple claim which holds for any Boolean function: 

Claim 9. Let f : {-1, 1}"— 1} be any Boolean function and < 5^ < y/e. //NSe(/) < 

2-e 

5^-^ ■ ye, then f is 5-close to a constant function. 

Proof For any Boolean function we have YlsM'^ ~ 2^)'^' ' ^ (1 " 2e) • Es^0/^('S') = 

(1 — 2e) • (1 — /^(0)) where the equality follows from Parseval's identity. Therefore, we can write 

Ns,(/) = 2 • - -^(^^ - ^^/i - 2^)"" • > e • (i - T'm) 

which implies 1-/^(0) < 6^ /e^/^ < 6 where the first inequality follows from the assumed upper 

bound on the noise sensitivity and the second uses the assumption that 6~ < -/e. It follows that 
/ is 5-close to sign(/(0)) and this completes the proof. ■ 

1 

Using the above lemma, for the rest of the proof we can assume that 5^-^ > ^/e. 
Fix a weight-based representation of / as f{x) = sign(w ■ x — 9), where we assume, without 
loss of generality, that wf = 1 and > l^t'j+il > 0, for all i £ [n — 1]. For k £ [n], we denote 

'= \I^Ji=k^- The proof proceeds by case analysis based on the value of the e-critical index of 
the vector which we now define. 

Definition 10 (critical index). We define the r-critical index ^(r) of a vector w E M" as the 
smallest index i S [n] for which \wi\ < t ■ ai. If this inequality does not hold for any i £ {n\, we 
define £(r) = oo. 



The case analysis is essentially the same as the one used in [SctOTI IdGJ+10] . Let I = ^(e) be 
the e-critical index of /. We fix a parameter 

L(e,5)''=^'G(^-log(l/e)-log(l/5) 

for an appropriately large value of the constant in the If ^ = 1, then the linear form behaves 

like a Gaussian and must be either biased or noise sensitive. In Lemma 11 11 we show that such an 



/ is either 5-close to constant or has noise sensitivity Q.{5'^^ ^J\og{l]W)y/e). (See Case I below.) If 
I > L, then previous results |Ser07j establish that / is 5-close to a junta. (See Case III.) Finally, 
for 1 < ^ < L, we consider taking random restrictions to the variables before the critical index. If 
a (1 — 5)-fraction of these restrictions result in subfunctions which are very biased, then / must 
be 35-close to a junta over the first L variables. Otherwise, a 5-fraction of the restrictions result 
in regular LTFs which are not very biased, and we can apply the results from Case I to show that 
the noise sensitivity of / must be too large to satisfy the conditions of Theorem [3j We show this 
in Lemma [T5| Case II. Our requirement on the noise sensitivity in Theorem [3j which is probably 
stronger than optimal, comes from the analysis of this case. 
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We now proceed to consider each of these three cases formany. 
Case I: [i = 1, i.e. the vector w is e-regular.] In this case, we show that / is 5-close to a 
constant function. The argument proceeds as follows: If < 1 — S, we prove (Lemma |11|) that 

N§e(/) = ^}{6^ y^log(l/(5) -T/e) contradicting the assumption of the theorem. Hence, |]E[/]| > 1—6, 
i.e. / is 5-close to a constant. Our main lemma in this section establishes the intuitive fact that a 
regular LTF that is not-too-biased towards a constant function has high noise sensitivity. 

Lemma 11. Fix < e < 1/2. Let f : {—1, 1}"— T-j— 1, 1} be an e-regular LTF f{x) = s\gii{w ■x — 9) 
that has |IE[/]| = 1 — p. Then we have 

NS,(/) = niipTh 0og(l/p) • - 0{e). 

Case I follows easily from the above lemma. Suppose that p < 5. Then the function / is (5-close 
to a constant. Otherwise, the lemma implies that N§e(/) = Vl{5~^ y^log(l/(5) • ^/e) — 0(e); since 

> y/e, this is Q{6'^ Y^log(l/5) • y/e). This contradicts our assumed upper bound on NSe(/) 
from the statement of the main theorem. 

The proof of Lemma [Tl] proceeds by first establishing the analogous statement in Gaussian space 
(Lemma |12| below) and then using invariance to transfer the statement to the Boolean setting. 

We start by giving a lower bound on the Gaussian noise sensitivity of any LTF as a function 
the noise rate and the threshold of the LTF. The following lemma is classical for 9 = 0. We were 
not able to find an explicit reference for arbitrary 6, so we give a proof for the sake of completeness. 

Lemma 12. Let < e < 1/2 and ^ G M. Let X and Y be p '= (1 — 2e)- correlated standard 
Gaussians. Then, 

Pr[sign(X — 6*) / sign(y — 9)] > (1/vr) • arccos(p) • e ^+f> . 

Proof. Let X and Y be p-correlated standard Gaussians. As is well known, {X, Y) can be generated 
as follows 

X = Zi = (Zi,Z2)-(l,0)^ and Y = p ■ Zi + - ■ Z2 = {Zi, Z2) ■ {p, \/l - p")^ ■ 

where Zi and Z2 are independent standard Gaussians. For the random variables X — 9 and Y — 9 
we can write 

X-9 = (^Zi-0,Z2-0-y^^) -(1,0)^ and 
Y-9 = (^Zi-0,Z2-0-y^)-(/.,V^r^f. 

Fix a '= and consider the 2-dimensional random vector T = (— Z2 + a9, Z\ — 9). Note that 

T is orthogonal to the vector (Zi — 9, Z2 — a9). 
We now observe that 

Pr[sign(X -9)^ sign(y - 9)] = Fr[T "splits" vectors (1,0) and (p, y/l - p2)] 

We refer to Figure [T] for the rest of the proof. Let R be the region between the horizontal axis 
(the line spanned by (1,0)) and the line spanned by the vector (p, y^l — p"^). The RHS of the 
above equation is equal to the probability mass of R under a 2-dimensional unit variance Gaussian 
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centered at {aO, —9). We estimate the Gaussian integral restricted to the region by considering 
points at distance r > ro from {a9,—9). Using polar coordinates to compute the integral, we 
obtain: 



Pr[r "splits" vectors (1,0) and (p, VI - p^)\ > - / 

= - / (/3(r) -7(r))re-"'/2d^. (i) 



re 



The angles I3{r),"f{r) are illustrated in Figure [T| and rg is the distance of the point {a9, —9) from 
the origin, i.e. 

ro = ^a/TT^ = (2) 

where the second equality follows from the definition of a. To compute ([T]), we need the following 
claim: 

Claim 13. For all r > ro, it holds that (/3 — 7)(r) = arccos(/9). 

Proof. Let x{r) and y{r) denote the angles illustrated in Figure [T] First, observe that /3(r) = 
x{r) +y{r) and that x(r) = arccos(/9). We also have that 7(r) = arcsin(0/r) (the vector of length r 
originates at {aO, —6) and stops at the origin). Finally, an easy calculation shows that the distance 
from {a9, —9) to the line spanned by {p, \/\ — p^) is exactly 9, and hence y{r) = arcsin(0/r). ■ 
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Therefore, the RHS of can be written as follows: 

— / (/3 — 7)(r)re~^ ^"^dr = (l/vr) • arccos(p) • / re^^ ^"^dr (using Claim 13) 

Jrn J rn 



'ro -fro 

(l/vr) • arccos(p) 



= (1/vr) • arccos(p) • e ""o/^ 
= (I/tt) • arccos(p) • e 
where the last equality follows from ([2]). This concludes the proof of Lemma 12 



We are now ready to give the proof of Lemma 1 1 



Proof of Lemma \11\ We first bound from below the Gaussian sensitivity of a halfspace as a 

function of its bias and the noise rate. Let {X,Y) be a pair of p '= {1 — 2e)-correlated standard 
Gaussians. Consider the one-dimensional halfspace hg : M— )•{— 1, 1} defined as hg{x) = sign(j; — 6) 
and let |E2,^_/v'(o,i)[^6i(a;)]| = 1 — p. We claim that 

PT[he{X) + he{Y)\ = 0(pT^v/log(l/p)-^/i). (3) 
We show Q as follows: Lemma 12 implies that 

VT[he{X)^he{Y)] = n{^e-e-^^) (4) 



where we used the elementary inequality arccos(l — 2e) = Vt{^/e). We now relate p and 6. We claim 
that 

p = e ' 

From this it follows that 



\e\ + i 



e-^V2 = (pyb^(I7|)^ 

and Q yields Q. It remains to get the desired bound on p. Assume that > 0; for < the 
argument is symmetric. First, it is easy to see that 

IEx~Ar(o,i)[/^0(^)] = -l + 2$(e) 

where ^{9) =^ Pi"2:~Ar(o,i) > Since 6* > 0, we have ^{9) < 1/2, hence p = 2^{9). The desired 
bound on p now follows from the following elementary fact: 

Fact 14. For all 9>0, it holds $(6*) = Qi^^j^)- 

We now turn to the Boolean setting to finish the proof of Lemma [TTj Let / = sign(t(; ■ x — 9) 
be a Boolean e-regular LTF (where without loss of generality \\'w\\2 = 1) that has = 1 — p. 

We use ([3]) and invariance to prove the lemma. The following sequence of inequalities completes 
the proof: 

NSg(/) = Pr[sign(w ■ x — 9) ^ sign{w ■ y — 9)\ 

« Pr[sign(X - 0) / sign(y - 9)] (5) 
= f](pi^Vlog(l/p)- Ve)-0(6) (6) 
= 0(pT^v'log(l/p)- V^)-O(e) (7) 
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where ^ follows from Theorem [s] and ^ is an application of ([3]). To see ([T]), note that, by 
Fact [7] (a corollary of the Berry- Esseen theorem) we get that p ~ p , and hence Y^log(l/p) — 

pV(i-)^log(i/p)| =0(e). ■ 



Case II: [1 < £ < L.] In this case, we show that / is 5-close to an £-junta. 

Consider the partition of the set [n] into a set of head variables H = [£] and a set of tail variables 
T = [n] \ H. Let us write H{xh) to denote wh • xh and T{xt) to denote wt ■ xt, the linear forms 
corresponding to the head and the tail. 

The argument proceeds as follows: If a non-trivial fraction of restrictions to the head variables 
lead to a not-too-biased LTF, we show that the original LTF has high noise sensitivity contra- 
dicting the assumption of the theorem. On the other hand, if most restrictions to the head lead 
to a substantially biased LTF, we argue that the original LTF is close to a junta over the head 
coordinates. 

Let p e denote an assignment to the head coordinates and fp be the corresponding 

restriction of /. Note that for any restriction p of the head variables the resulting fp is an e- 
regular LTF (with a threshold of H(p) — 9). Formally, we consider two sub-cases depending on the 
distribution of |IE[/p]| for a random choice of p. 

Case Ila: [This case corresponds to Prp [|E[/p]| < 1 — 5] > 5.] That is, at least a 5 fraction of 
restrictions to the head variables result in a "not-too-biased" LTF. Since each of these restricted sub- 
functions has high noise-sensitivity, we can show that the overall noise-sensitivity is also somewhat 
high. This intuitive claim is quantified in the following lemma. 

Lemma 15. Let e,5 be sufficiently small values that satisfy 6^ > y^. Let the e-critical index £ of 
f satisfy 1<£<L. //Prp [|E[/p]| <l-5]>5, then NS,(/) = ^{d'^^ ,J\og{l/5) ■ ^e). 

Therefore, in Case Ila we reach a contradiction. To prove the above lemma, we need the 
following claim, whch implies that if a noticeable fraction of restrictions to a Boolean function have 
high noise sensitivity, then so does the original function. 

Claim 16. Let f : { — 1, 1}"— T-j — 1, 1}, R C [n] and p G { — 1, he a random restriction to the 
variables in R. For any e > 0, i/ Prp[NSe(/p) > t\> 5, then NSe(/) > t5. 

Proof. The following elementary fact will be useful for the proof: 

Fact 17. Let f : {-1, 1}"^{-1, 1}, R C [n] and p G For any S C {[n]\R), 

Ep[fp{Sf]=^f{SUTf. 

TCR 

By linearity of expectation and Fact [TT] we get that 

Ep[NS,(/p)] = ^ • Yl (l-(l-2e)l^l)- 5]/(5ur)2 (8) 



SC{[n]\R) TCR 



On the other hand, we have: 



NS.(/) = I- E 2:(l-(l-2e)I^W^l)./(5UT)^ 

SC([n,]\_R,) TCR 



SC([n]\_R) TCR 



\. (l-(l-2e)l^l)- j;/(5UT)2 (9) 

SC{[n]\R) TCR 
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Combining equations |8] and [9j we obtain 

NS,(/) > Ep[NS,(/p)] > dr. 



Using the above claim we can prove Lemma 15 



Proof of Lemma By Claim 16 and the assmnption that Prp [|E[/p]| < 1 — 5] > (5, it suffices 
to show that fp is noise sensitive whenever |IE[/p]| <1 — 6, i.e., that 

NS,(/p) = 0(5t^7Mi75) • Vi). 

This follows from the fact that fp is an e-regular LTF. Applying Lemma [ll] with p = 6 > 
completes the proof. 



Case lib: [The complementary case corresponds to Prp [|E[/p]| < 1 — (5] < 6.] That is, with 
probability at least 1 — S over a random restriction of the head, the bias of the corresponding 
restriction is "large." In this case, a simple argument yields the following: 

Lemma 18. Let f : {-1,1}" ^ {-1,1}, H C [n], and < 6 < I. Suppose Fvp^H [|IE[/p]| < 
1 — j] < 6. Then f is 36 -close to a junta over H . 

Proof. Let B C {— 1,1}I^I denote the set of bad restrictions, where we say that a restriction 
p G {-1, 1}I^I is bad if |E[/p]| <l-5. Define g : {-1, 1}" ^ {-1, 1} to be: 

(x) = [ ^ if G S 
^ 1 f{x) otherwise, 

and note that g is (5-close to / since \B\ < 6 ■ 21^' by assumption. We also have that g satisfies 
1^(0)1 = |E[(7p]| > 1 — 5 for all p G {-1, 1}'^'- Now consider h{x) = Y2sch 9i^)^s and note that 

11^ - 9\\l = E 9iT? = E [Var(<7p)] = 1 - E [5p(0)'] < 1 - (1 - 2<5) = 26. 

TgH 

Since / is 5-close to g and g is 25-close to sign(/i) (a junta over H), this completes the proof. ■ 
This completes Case IL 

Case III: [d. > L\. In this case, we merely observe that / is (5-close to an L-junta. This follows 
immediately from the arguments in [Ser07| lDGJ"'"10j . In particular, 

Lemma 19 (Case 11(a) of Theorem 1 of |Ser07| ). Fix e,6 > 0. Let f he an LTF with e-critical 
index £ > L. Then f is 6-close to an L-junta. 

The proof of Theorem [3] is now complete. 

Acknowledgements. I.D. would like to thank Guy Kindler and Elad Hazan for useful discussions. 
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